ft 



DOCOaSHT BBSOHB 



SD 203 <403 

ROTHOR 
TITLE 

POB DATE 
NOTE 



EDBS PRirE., 
DESCRIPTORS 



^IDENTIFIERS 



Bar^ifett, George R. : And O.thers 
The ose Qf Fractionation .Scales for 
Audits. •» 
May 91 • * 
33p.: Paper presented at the Annual 
International Communication, Association 
HN, Bay 21-25, 1981) . 



CS 

r 

Communication 



Meeting of the 
(Minneapolis, 



MP01/PC02 Plus Postage. 

*Rttittidev Measures: *Communicati'On Research; 

*Employee Attitudes: ^'^Measurement Techniques: 

Measures (Individuals)^: *Organizational ^ 

Communication 

* Fractionation Scales 



ABSTRRCr 

> A study i 

organiza[tional communicat 
in use. The method, which 
with workers from five di 
multinational corporation 
use the scales reliably, 
variance than did the tra 
to discriminate a greater 
traditional scales, and ( 
obtained. (PL) 



nvestigat^d an 
ion other t^n 
employs frWli 
fferent busines 
• ?he rissnlts s 
(2) the method 
ditional proced 
^ number of valu 
U) thepreticall 



Gw method of measuring 
vthe audit 'methods currentj-y 
onation {>rocedureS, w^s used 
s groups within a large 
howed that: (1) workers could 
produced significantly jDore 
ures, (3) employees were able 
es than allowed by the 
y valid relationships were 



* Reproductions suppli€|d by PDRS .ar^ the best. tha*t can be made * 

♦ ' from the ofigin^al document, f * 



ERIC- 



V 



• 1 



The Ose of Fractionatijon Scales for Communication Audits 



U.8. DEPARTMERjfT OF.EOUCATtON 
NATIONAL INSTITUTE OF EDUCATION 

/f EpUC>\flCHUAL RESOURCES INFORMATION 
L CENTER (ERIC) 

p^hb document has been reproduced as 
. received from the person or organuation 

originating it. ■ 
I 1 Minor changes have been made to improve 
reproduction quality. 



J 



• Points of view or opinions stated in this docu- 
ment do not nocessariiy represent o^ficlal NIE 
position or policy. 



O 

o 

CD 



Depar 



6eorqe;[ A« Barnett ; 
Department ot Comnjunicat;Lon - 
State University of Nev Jork at Buffalo y 
Buffalo^ Nen York 



Donna M. Hamlin / 
Communication Research Laboratory 
tment of Lanquaqe, Literature and Conmanication 
Rensselaer Polytechnic Insti^te 
'/,r, Troy; Nev York 



7 



James A. Danonski 
School of tfournalisffl add nass Communication 
University of Wisconsin 
Madis;on# Wisconsin 



October/ 1980 



Paper submitted for presentation to the organizational G^>i»iniunica^iQ'^ 
l^vision of the International Communication Association 

' • \ > . . ' ^ ■ ' . • ■ ^ 

1 ''PERMISSION TO REPRODUCE THIS 

MATER|Al4iAS BEEN GRANTED BY < 



George A* Barnett 



JO JHE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." ^ 



EKLC 



2 \ 



The Ifsre of f raqtipnat ion Scales for Communication Audits 



. Ab 
ThiiB paper proposes a new a 
ofa^inizeft^onal coamunication tha 
ICAI^Cbmittunication Audit and oth 
jrformedi with employees from 
larae* multinational corp 
on procedures. The r^s 
2), they 'Use then re 
more variance.., than 
reater nujaberr<if 
items ^ and^ 5) the 




result of p these fi 



As 

of direct-maqnitude« es 
of organisational cc^ 



tract 

d more precise method of /measuring 
n the :one currently eoployed by the 
er- audit systems. An.. audit was' 
five diffierent business , groups from 
oration to de't^i^iBine the utility of 
alts ^showed that, 1) workers can use 
liably, 3) these methods produce 
traditional procedures, U) workers 
i^alue:^ than /allowed by traditional 
oretical^ va.lid tfelationships were 
ndlnqs^this - paper advocates- the 
timate fractionation scales .for the 
feunication. , \^ 




/ 



3 



r 



Ijlie Ose of Fraict i>cmation Scabies for ConTrajini cation Auait^ll 
!• intrpduction 

' Since the first systematic ' measurement of ^ organizational 

communicatioa some thirty years aqo (Jacolson R "Seashore, .1951); and 

-■> ^ ' 

the first published use of the term "communicatioil audit" some five 

\ : ■ ' . 

years later (odiorne, 1954), the aeasurement of organizational 
communicra tion has grown from a scattering of single-method, single^ 
organization, one-shot research attempts to systematic multi-method, 
investigations in large numbers of orcjanizations. Fo^: example, the 
LTT/OCD audits, similar to the ICi Audit (Goldhaber 6 Rogers, 1979), 
have been repeated by| Riio (1979) and associates in at least 29 
or;faniza tlons, mainly injFinland. T*f> ^CA^udit itself has so far 
beem applied to - over I20 organizations i^n the United States and 
^Canada. Because the latter has been more highly publicized and 
institutionalized, it is the subject ^ of focus here. However, a 
complete discussion of the ICA Audit is bey^ond the sc'ope : of -this 
paper* For an excellent destfripticn of the Audit we highly recommend 
tSoldhaber and Bqqer^^ftl 979) i ' / 

The^ iCA Audit is operated by an organization of its own 
numbering in the hundreds of m^mb.€rs« It has implemented formalized 
trai^ninq and ' certification procedures for them,, as well' as 
centralized the management of instrument developmentt analysiis 
procedures^ J and data base management. This organizing appears to 

have had positive ||pffects on the social aird . theoretical 

f ' » ■ 

in trastf ucture of the organisational communicatipn fi4ld. Perhaps/ 

foremost and far reaching aire some in^rect effects. The Audit has 

ft-' ^ * 

expandcFd and made moire discernable the "invisible qpllege" of, 
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organizational conauinication scholaris* It also appears to have 
fostered greater conceptual consensus. Similarly, it may have 
st'lmulated the number, scope, and quality of comprehensive 
Jiiterature reviews (Coldhaber, et al., 1978; Dennis, et al., 1 978; 
Wo^qe, et al. , 1978; Farace, et al,., 1978), and texts (Farace, * et 
al.., 1978; Rogers f- Rogers, 1977: Goldhaber, et al. , 1979) which 
have appeared in the last few yqars. It may not be entirely 
coincidental that most of these syntheses ha^ve multiple authors. 

Tfce Audit has alsc)^ more direct and immediate/ef feet through its 
professional educationH role. Research skills and knowledge ataong 
scholars has grown more awidely, and rapidly than would have occurred 
without auditor trainiK&g and cejrt if ication- F/arthermore, the^ Audit 
has jfexpanded scholars » a ::cess to organiza ti b^:^ and hence, increased 
therr richness of c cperiences about practical organizational 
^communication problems, |is a result, theory construction efforts 
ha ve '^profited. 

While the Audit ^ppears to have had thase major met^- 
theoretical organizational^ effects, it also appears to have ^nhknce^, 
the substantive and metnbdclogica 1 quality of organizational 
.communication research. PeVhaps most significant among a number of 
such effects is that the Aulit offers promise, or *aLt least a 
prototype, for enabling carefujv; examination of some critical issues. 
In particular those .concerning tiie: 1) generalizability of findings, 
2) levels of appropriate aggregation , and 3) appropriate statistical 
testing procedures, these are issuVs thought important by proponents! 
jgand critics of organizational communication theory. Clearly, such 
examination is possible (because the MiVery same methods ^are beings 
applied to a pumber ckf organizations* 



Nevertheless, histein lies a potential theoretical fault. It can 
be inferred from continqency theories (lawrence G ^l^rsch, 1 967; 
Galbraith, 1977) that organizational communication processes var.y 
widely,^ depending on e uviro omental conditions. !Rhus, mechanipai 
administration of the same measures across different organizations 
(or different functional subunits within one organization) ^ay. fail 

to capture not only, impd^r^ant variance among, them, but crucial 

» * • • , 

unique variance witMn* many different; organizations, This^^sug^gests 

. . v' ^. ^ • • / ' . 

that extending continqency theiory ^o,,.>the methodological level 
requires applicastion of a puston mix of measurement tools for each 

orqaaization based on otherwise known ch^gtracteri-st ics- - Recent 
- ^ . ' / . , ' . / 

empirical evidence may ,be used to, si^ort this position^ (mahmauji. 

1977#1979; Danowskx^ 1980; Kapitula - e ^Barnett, uaaer review). 

Obviously, as the variance increases in applying such lo^pls, 

theorists^ dreams of empitically treatinq -^issues of 

qeneralizability^ aqqreqation, and statistical testing would drif^ 

further from fallfillment. 

Nevertheless^ ,a notable countierjLrjguroent to the radicaJL 

extention of conti^iqency views ,exist on both theoretical and 

measurement levels* Continqent variation is not scientifically 

observable unless the same measurement -procedures are consis"tently 

^(^plied aicrOiSs orqaniza tions- Otherwise/ continqency, "theordes" 

cease to be such, for they are not falsifiable. Obseriyed contingent 

variation m?iy be an artifact of the variance in measurement 

techniques used. Tl^is alternative explanation cannot readily be 

tefruted without the same measurement techniques being used^ across 

different organizations.' -I 

Nevertheless, this counter argument is not intended to lay to 



rest theoretical questioning of the nea sux;e mcnt procedure used by 
the ICk, LTT/jfoCD or other audit apriroaches. If the audit scales, 
despite their cansistant application/ do noyb represent precise 
variance in organizational caonurica tion processes, then they are 
limited* Wide scope theory construction and revealation o\ subtle 
effects are restricted/ In general, the more the processes of 
stolen tific interest varies/ the m^re precise the measurement scales 
must be* This is particularly true, since accurate assessment of 
Changeover time important. Also, at a practical level, more 
"PyT^C^^^ scaling, enables finer adjustments in an organization's 
mmunication patterns. Furthermore, there is increased opportunity 
to observe impacts on organizational effectiveness* 

Host standard auditing . instruments rely on crude ordinal 

• ■ ■ 'V . .. • X ■ ^ 

'.sqal63, m4inly -U px 5. point' Likert-type scales, ani solnetimes 7 
point Semanfic Differentiil Scales. CleAfly,- inyestigktors have n'ot 
chosen theise, limited scales out of^%heer nai^ite. don temporary 
[although lirgely untested) academic "folk visdom" holds that most 
workers cannot effectively understand "or use more sophisticated 

scales* So, cpmprojnises in measurement have been made. . * 

■4 ■ . . ' 

However, the l)asic principles of scientific evidence suggest it 

• 1- ^ ^ ^ ' ^ ■ ' ■ * ^ 

\^ .inappropriate to leave such important scaling assumptions 

.untested; The potential theoretical dmpliccitions are too great. For 

th^s reason, we embarked on tfce research reported here, which 

measures many of the same constructs used to measure cbmmunicatidii 

ciiaate in- the ICA and LTT/OCD Audits. However, we used metric 

fEaetiaaaiio^ scales, rather than ordinal scales. Before reporting 
. ^ ^^^^^ 

actual — methods^, samples and results, the issues surrounding 
sj^dard; ordinal and more pre[cise scales sbou^ be di^ussed. ; 

^ 7 • . ■ 
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!!• Measurement Theory ' ' 

' TKe process of measurement essentially invoijLves setting in a 
one-to*one correspondence the laqnitude or quantity of, some 
attribute possessed by a set of stimuli Wth the set pf 'reaiy 
numbersl ' The real number 'system ha« five ' properties which are' 
impolrtant to the measurement process. They are; 1) It i^ ordered^ 
Sflch that^ one is le;ss than two is less than three, and so on, 
(1<2<3<.. .<n- Kn) . 2) T*he distances betwfee^ the intervals are equal. 
That is, the difference between 2 and'^^is eqaal to the, difference 
between ^ and 5 (3-2=5-U). 3) It has^ a true (absoluteiV zero point. 



'The first three properties are those qe lie rally .associated with Ratio 
" scales. The real nttmbers have two additional properties whi<ih have 
important implications ^or measiycemen t. U) The real number system is 
^ unjxfunded -or infinite. 5) Iris infinitely dense..*}Between any two 
values a third can be placed without limit. b 

It is liiportant to select a measarement system which meets 
these requirements ^because the Jtocls of mathematics can b^ more 
fiilly ap^f^ied to the qathered data. When chqosinq^ one that does not 
meet these 'requirements the researcher must set aside certain 
assumptions before p^rl^rminq any mathematical - operations. For 
example,; to divide rgquireis an absclut« zero paint. Without if/ the 
ratio i^ meaningless- . ^ 

The ICA Communication Audit currently employs Lik^t-type *items 
to measure an organization »s communication patterns.^ They are 
bounded, five point fixed-choice items. They neet only the^ first two 
requireme/its . of the real numbers order and. equal intervality. They 
fail to meet the other three; th^y do not havfe' an absolute zero 
pointy the? a^e SeVere|LT bo^n^^' limit^q tie possible variation in 
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p aeasurea^nt, and, they limit density. Th^se rqualdties severely 

restridt the instrument precisioin ofV mee^^ure. Since these scales 
discriminate only five different values, they build 20% error into 
the measurement process. Due to their form, they are incapable of 
^ preclsi<5n, qreat^r than BOf. accuracy. When coupled with measurement 
error (assiqninq the . ^^timulus to the wrong category) and % 
unreliability* these measures may be further limited in validity 'and 
the recommendations to modify an organization's communication/ 
structure jB^y be erroneous. - • 

As^ an alternative to the currently c^mployed measurement 
procedures, the direct^ magnitude estimate form of fractionation 
scales m%y be used to measure an organization's communication. 
Tpcqerson (1958: 94) describes the f r-actionation aethod as follows: 

■ ~ - / • •■ 

The loqic of the fractionation methods cah be 
^ stated giTite. sitaply: It is \^ssumed .that a 

sub;)ect is capable of directnLy\j)erceiving and 
* rjep^rting the magnitude of a se'nse^ratio: i.e., \ 
. the fatio between two , subjective magnitudes. 
\ * This assumption is, ^f course, subject to tests 

*' . of interna^l consistancy. Fractionation method^ 
are found in/two g^n^ral forms/. In one form, the 
subject is preserited with two stimuli and 
. instructed to .report the . subjective ratio 

\ between them with riespect to jthe designated 

» attribute. For example, two t6nes of the same ^ 

pitch might te presented to thfe :^bject^ wi^h 
instructions to report the ratio of loudness of* 
, ^ the first tone to the second. We shall referf to 

I 7 methods tthat use this approach as direct- ^ 

\^ estimate methods. ' • 

The usual^ procedures this method employs and the approach this 

paper advocates, is \ essentia lly a special qase o'f ^ub j4ctive- 

estimat^ metl^d. Assume^hat there are n stimuli to be scaled with 

respect '^to some attrib'Ute. The researcher provides subjects a 

standAjpd, anchored at' one 4nd with the absolute zero poinik {none of 

the attr4l>ute) and at the ot^er by so'ie krbi^rary value. Often^ this 
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point is one of the stiauli to be scaled, either the largest or 
saailest sAaulus of the qroup. However, Stevens (1956) tecot^fends a 
■ laaie stiBulu<5 oi: an averaqe value tc serve as the ^standard • s upper 
bouna. This dOes not bo^na'the scale and is easier to use when the 
■aqnitudes of the individual ^t^u^i are unknown. The researcher 
then presents the remaining Stiouili along with the standard, and th^ 
subic'-ts estimate the ratio of the stimuli to the^standard, Repeated 
-judgements* by a large number of different observers are necessary 
to obtain stable estimates, 

Hhile these procedures have been frequently emplp^ed in 
psychophysical research tTorgerson, 1 958), they have less often been 

used to study attitudes or the perception of ^aJbstract attributes 

. , w . ' ' 1 

(such as how much information is received frJoj> a source). Some 

' ■ ^' 

notab^e^^^^ei^ deal with tlie mass media (Rarnett 6 WcPhaxl, 

1975, 19,80), perceived uncertainty (BarWtt Hughes, 1 978), 

oraan izational attitudes {Hamlin 8^ Haghis, i980) / perceived 
dominance/^rand^ 1980) anfl Attitude ch^ge (Kapl^wit2, et al,, 
1980). Hhile not directly comparable, the Galileo{tm) metric 
multidiiensiona^l . scaling procedures [Roel^a 6 Fink, .1980; Hoelfel, 
et al., 1980) uses -a variat ionyJof the same^ method. The researcher 
provides subjects a standard wher.e zero is no difference' and some 
value is set as Jthe ?staiyi^rd*s'^ upper limit. The subjea^s then 
determine the magnitude ot^^'^ifjfefrence amji^cugi pairs Yf^oncepts. 

- There are a number It a^vaitages of fractionation scales made 

• , ^ / . ' ) ■ ' ^ ^ 

possible by their correspondence to the real number system. They 

allow for considerable variance. They are unbourt^ed' and are ideally 

suilted to ^measure change ovei; time and thus> " ti^e process of 

Communication. They ^re capable of fine discri^i|uitions among 



stimuli and they do not build error into the noasurem^nt process, 
AJLso^ they have advantages in theory construction <Vnd allow for 
qreat|6r^control over the measured pherom^non. He shall deal with 
these adVantaqes one at a time, ^ ^ 

According to Danes and Woelfel (1975)^ a goal of the 
■ e^asuremetit process is to credte a scale which will majcimize the 
potential variation in the magnitude of a measured attribute-*^ While 
maxifljizihg the v^g A ^nce^ a scale should also be reliable. That is^ 
if a group of observers measures a set of stimuli, when they again 
measure the stimuli in the future, the variances should be the same, 
^or ^ny single stimulus, however, the goal of the measurement 
process is for the different observers to agree on the precise 
magnitude ot an attribute pocessed by the stimulus and thus to limit 
the variance about the mean ^^^^jifl^^*^^^ measurement of 

organizational communication^ many different individual stimuli may 
be measured by a single guesltion. For example, ♦•How much information 
do you receive from your^ immediate su pervisor?** This question may 
evoke a variety of responses\ For example, there may be a number of 
different supervisiors and, ideally, the measures should precisely^ 
discriiinate how they vary in the amount of information they make 
available to their subordinates. Thus', the criterion for selection 



of a measurement ^s ystem to observe organizational communication 
should be one th^t maximizes Yariatnce while at the isame ^ti^me 
maximizing the reliability. The di^ct magnitude estimate form of 
^^actionation scales meets this . requirement i.4>f^ maximizing the 
potential for variance.^ Its reliability in organizational settings 
may be determined. ' " 

• ■ ■ : 1' ' ■ . 

Because f racatioha tiom scales have a true zero point and are 



unbounded^ they ^aro capable of aeasurinq chanqe over ti«e and, the 
process of cdiaunica tlon. Sublects are free to respond with any re.al 
number when describing an orqaaizat ion* s conaunica tion patterns. 
True variance is not^ .^limited by the .scale. as a result, the 
differences in coamunica tion patterns are not homogenized and the 
differences among organizations (or functional subsystems) are not 
restricted. No matter how extreae an 1u</geaent aay becoae, the 
instrument is capable of describing v this change^^The variance^ 
coupled with the true zero point, makes possible^ the calculation of 
the rate of organizational^ change with ^rea^ precision. Dy 
subtracting the scale valj^es^' o ver tiihe, change may be expressed as la 
velocity. Velocity is the^^atio of change In the magnitude- of an 
-attribute to^ the .ckallge in: time (V = s/ t)* Given multiple* 
measures, accelerations may also be calculated, llgain, acceleration 
is a ratio of the chanqe in ^velocity to. the change in time (A - V/ 

r ^ 

t) • ATu^ale ri973, 1977) has arqued that velocity and acceleration 
are ne^^ssary to discuss the process of communication. Since the* 
crider scales have no true zero vpoint, calculations of these' ratios^ 
are impossible and any discussion of tlVe process of ^ommunica tion is* 



inappropriate* . » v ' « ^ 



This form of f ract ioimt>on scall has unlimited *^ensit^. Thus^ 
these scales do nat^^ui.^ jerror into the mea:^urement process^ 

althouqh error HaY result if an observ^ir assiqns the wrong value to-9 

c ♦ ^ , ' 

a stimulus. This j:haracteristic of the -scale is important*^ even if 

- 

observers do not use all the allowable values. (They can't; since ' 
the scale is dense without ^linitO It^ simply syiqgests that the 
measurement device is capable of precisian> limited onf y by an 
observer's senses and not by the scale Itself. * Xl*! ^ 



Scales of this form have ad-^antag^s il^^heory construction and 
in the empirical tests ^of these theorie^^^* their anrestricted' range 
and density make possible the determination of subtle relation's 
among variables* - This is of special importance when the relations 
are nonlinear' or when they hold cnly , withifi certai^n limits. The 
crude scales truncate the range and obscure the limits*. They allow 
for only the grossest nonlinear relations. The gpal# of science • are 
.precise prediction, to make possible the construction of accurate 
theories (explana l^ion) and subtle control. Given these goalie, obe^ 
should adopt measurement tccls which facilitate 'their 
accomplishments. 

The last point as important when afjp lying the findings of a 

* 

Communication Audit to improve an organization's functioning. Common 
gaestions. executives might ask- ertre^ "Wl;ere do the returns to my 
organiza'tion per dollar spent communication activities begin to 
aiminish?"r"Where will I get the greatest payoff per dollar spent on 
communication activities?" Or, "When will the payoff occur?". These 
guestions imply nbnlinear relations between'' money spent and th< 

Les 



magnitude of a measured communication a^ribute. The jflcalc 
currently used in the Audit are incapable of th'e precision n^^essary 



to answer these guestions.Thus^ evex^from an pragmatic view tiie most 
precise measurement system should be adopted, ^ 

Shile direct-nabnitude estimate fractionation scales haVe 
theoretical advantages, they have not been widely adopted to measure . 
communication variables. Certainly agrumen ts exist against th^ir 
use. We have* heard thre§.- One is that they are too dif^^-cult for the 
general public, e.g. , wprkersj who ^ingigte the contnunic^tion audit. . 
Two is because respondents ntey report any real number, they must not 

. ' 13 
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• be reliable. ^And, three is the question; Is it really neces]pary to 
"^^Ve scales vith such great precision when people do not normaliy 
differentiate in that much detail? ^ 

These' arguments may be taken to be Empirical questions. If 
three crxteri on can he met: 1) -workers are able to use these scales, 
^ 2) they do differentiate cbmmunicatian stimuli with more detail thali 
is allowed by the crude ti^aditional scales, and, 3) they are used 
reliably, then because of the theore^tical and practical advantfetges, 
they should be adopted for' t he ICA. C/pnmunication Audit. 

limited past^ empirical research indicates th^t the general 
public can use these measurement tools. ^.Barnett, 6t al* (1 976) 
measured political attitudes with a random sample of th§ public. 
Hamlin and Hughes (1980) used, t^ese scales ^o measur^ worker 
attitudes. In both cases'^, theorically valid results were- reported. 
Barnett and Hughes (1 978) reported a reliability of .929 for a .14 
item scales to measujrf; yoters* certainty of" the presidential 
candidates' issue positions. Brandt (1980) reports intercoder 
reliabilities of .949. in the measurement of dominance. 

HypoijbheseS' ^ \ ^ , 

The disscussion above, suggests |(rthe following hypotheses: 
1. Hi: Workers will be able^to use fractionation scales to 
describe the communication pattetDs'in the work place. 

2J H2:/Workets will use more that five levels of 
aisc|j^ina:tion' to different iatie their communication activities. 

3. JH3: Workers will use fractionation scales reliably to ^ 
describe thAr communication activities. These reliability levels 
will be equivalent to those reported for the current ICA procedures. 
And/ the fractionation method^iwill result in more reliable variance 



' / ' ■■ ^ ■ * 

than in the current ICA Audit procedures. 

Ill* Methods ' / ' . ^i. ,^ . 

To test^he above I^potheses, a coaaunication audit was carried 
out using fractionation scales to measure certain conmunication 
actiYles. 
Site Selection 

^ " ration were 




Five sites from with a large multina.tionai corpori 



selected to / reflect high contrast on sev|^ra|l dimensions-r 
communication/ practices^ unipn activities^ technology^ business life 



cycle status^ geographical^^cation and employee status composition* 

/ 

In this w.ayr it was possible to ascert;ain if a wide *range\of 

differe^tt types of v workers in different work situations could use 

the ^actionation procedures* The sites are described below: 

1/ northeastern^ non-union^ advanced technqlogy^ growing 
/ business, predominantly hourly work force 

/ 2 northeastern, tinion,^ high technology, growiilg . / 

/ business^ predominantly technical ^ hourly worK force 

3 southern, union, low technology , stable business 

predominantly* hourly work force 

j\ ^ ' ■ , 

4 ^ northeastern, non-union, E$D, hat vest business^ ' 

predominantly exempt scien,tists 

5 midwestern, non-union, low technology, sta'ble 
business, predominantly hourly work force 

Instrument Construction 

The instrumeat was designed and pretested at a sixth corporate 

site* It employed many of the same items as in the 1C& Audit's 

written guestionnaite. Paralell questions to the ICA instrument were 

used on: information received (actual and ' ideal) , sources of 

information, (actual and ideal), and ' organizatiojial outcomes.. 

However, these Questions were altered to use fractionation scales* 

For example, workers were asked to score how much information they 

■ : • ^ 15 : .• ' ■.• 
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receifeJ titelve brganizatioDal topics. EacR^ question asked 

• 'respondents to let 50 represent the average amount b£ a given topic 

• ■ • * / • ' 

^and zero represented none of the topic. Employees were asked* to 
quantitatively estimafte hou much information tjiey recfeiyed in 
relation to this standard. Next, the employees i#ere asked tp 
estimate hoW. much th^y needed of each information topic. 

Employees also scbred 1# sources of information, using the same 
scal^, fot six attributes: a(ctual use, perf erred use, ease in 
access, usefulness, accuracV and timeliness* The sources were: 
coworkers in my u^it, woi^kers in other units, supervisor , middle 
managers, top mai^geirs, the grapevine* group meetings, loca?*^ plant 
nsfwspaper , local publications ^ and newsletters, written letters, 
memos ^nd repoirts, bulletin^, boards, company wide annual reports, 
V Local radio and tv newsv ^ ^|j|> ' j 

Further, in line wfmh the ICA Audit, employees were asked how' 
^tisfied they were with 11 organisational ^ environment attributes. 
Again, employees were to assume that 50 was average satisfaction and 
zero was no satisfaction. The irstrument also included site unique 
guestions, or what Goldhaber and Sogers call cafeteria items. A copy 
of the complete questionnaire, with obscured references to the hpst 
. corpomtion, appears at the end of the paper. 
Data Co^ection 

Selection of subjects was determined through a single stage, 

stratified random sample. The prinary sampling unit for the study 

was' the individual employee. Population composition data were 

collected for edch site,. Sampling strata were defined by worker 

status — hourly individual contributors^r nonexempt salaried, clerks, 

secretaries and technicians, and exempt professional contributors, 

... % 



The QUjirber and coBp)t>sitiorr of strata varied among the sites as a 

result of the frequency of vorJcers * assigned to each of, several 

vorker categories. The strata ' constructions were determined as a 

result of the number rof workers iA each, category. ^ . ' 

An analysis of thie standard errors from the pretest results 

indicated that variation' in responses was associated with- worker 

status. Direct examination of .^he .standard errors, implied, on jh^^ 

variables, that the opinions of hourly employees wer^ less variable 

than those of exempts employees. As a result of this pattern of 

variability, it wa6 determined that the most appropriate sampling 

> ' • .. . ' ■ • , 

allocation procedure was Optimum* or Neyman Allocation (Neyman, 

. . ■ ' • . ^ 

1934) • It is designed to nrlnimize within stra'^um variance for a 

fixed- total sample s«e. , ^> 

^ Cost and production restrict^cns limi^fced the -sample size 
decision for thia study to 20% of the -total popuiatioij: i?or es^ch 
independent site. Employee names were randoibly selected ^ for '^"each 
stratum with the aid of seguential personnel computer listings. A 
random number table was used to identify the participants.* 

Written guestionnair.es were admijiistered in group meetings at 
each site. An administrator wqs present "^to answer any questions 
raised by employees. The number'6 of participants and response rates 
appear in the results section. , 
The Evaluation of the Hypotheses ^ 

HI: To evaluate hypothesis 1, the response rates for the 

* * . 

indivdual items will be examined. Since these data will be used only 
in a descriptive manner, to indicate* whether or not respondents can 
complete fractionation scales, no . inferential statistics will be 
calculated. That is, »no test of significance will be performed. 



H2: To a'etermine if the sublects IfSe more than .^f ive categories 
when completing the guestionnair€# the folloning procedures will be 
performed. The unique responses from each sit^ for every item are 
counted- Then r they are averaged among the five sites to control for 
^ the effects of sample sitBm Th^s value^ the mean" number of unique 



responses for each item, will be th^e unit of analysis^for the test 
of hypothesis 2. A sinrpie T-test will be perfQT^med to determine if 
this value is significantly grfeater than the ^ possible number of 
diTferent responses (5) in the ICi Audit. ) 

H3: Hypothesis \3 will, be evaluated^ by determining the 

A ^ ' •■' ^• 

relxaJ5iliti«s and Variances of five ^scales (Inf ormationy Received- 

Actual, Information Received-IdeaXy Information Sou rtf^s- Actual, 
Information Source^Ideal and Organizational' Outcomes) These will 

. ■ ■ ■ ' 'V I ' ^ ^ • ' V ' . > ■ ■ 

be compared to the equxvalent ;§cales in the ICA Communicatioft\ Audit/ 

using the coefficients reported ^y GoldKaber an,d Rogers (1979).. 

, • . *. . ■ ' ' • . ^ i ■ " 

To cojBpare the reliability bf the^e new measjlres with the ICA 
Communication Audit, Cr'ohbach»s alpha will be used. The^e procedures 
are routinely applied * to alV new tests (Nunnally, 19-78: 21 4) . The 
formula for alpha is: , ^ - * 

rkk = .X/k'-1 (1- / ^ ), 
where, rkk =the -reliability of the whole test 
k =the nunibey o^ -i tales ' ■ 

=the sum of the itejns in the covarlH^ matrix \ / 




Coefficient alpha provides a good estiamte of reria^b^fea^ it 
is based on --the internal consistency of the instr ume^ntfs ^ items. 
Thus, this formula copsiders sources of measurement' error tl\at are 
not based strictly on the sampling of items, but rather on the 
sampling of situational factors accompanying the items (Nunnally, 



\ 
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1967:210) • Due to the uniqueness of the objective environments of 
the five sites^ the reliability cf th^ scales was determined 
separately. 
IT- Results 

Hi: The response rate for the fractionation scales ranged from 
92% to 97%, with a mean for the five !5it4s of 95,695. T'he lowest 
response rate for any set of items for any of \ the five sites was 
86*, Clearly^ workers seem.to be able to us€f these scales. But do 
they do it reliably? And^ do they use' a ^.wide 
them? 



range of points -on 



^ fi2: Tb, determine if the subjects used mote than five categories 
Tihen completing the guestionna ire, the uniguo responses from each> 
site for every itiem were counted. J2 Then, they iere averaged among 
the five sites to control for the effects of sample size,|3 ^he niean 
number of unique responses for each item was the unit of analysis 
for the test of hypothesis 2., Because of the veiriance in t^ie five 
sites' communication environments, only 66 of the 72 items were used^^^ 
for the analysis. Six of the items were not ap;propriate for aLl 



sites. There were no mass media. 



/ 



The mean number of different responses for tfiese 66 items was 
ia.6. The standard deviation was 1.73. This value is significantly 
- greater than the . possibl e number of different responses (5) in the 
IC4 procedpres^(t=5.55; p<.0005) • Further, even if the current ICA 
format were changed to 7,9 or 11 point scales, they would be 
inadequate to measVire the discriminatory 'ability " the current 
subjects. T equals 4.39 (p<,0005) for a 7-point scaie, 3.24 (p<.0054 
for a 9-point scale and 2.08 (p'<.05) for an 11-point scale, clearly, 
the subjects discriminate with finer detail than is allowed with 



such.>ft£; used b 



traditional fixed choice scales^ suchVa^s used' by the ICAalra other 
audit systems* ; ^ 

H3: Workers do use these scalei^ reliably. . 

* 

Cronbach!s alpha ^or the the, mean af the five sites of 
each of the groups of , items is prl^ented below, along wit Ir the 
reliability coefficients , for the conparaiDle items reported by 
Goldhaber a.nd Rogers (1979) . 

f . - , 

fract N of items ICA N of items 
Info. Received Actual * .862 
Info- Received Ideal .r918 
Info. SDurces Actual ^ .798 
Info. Sources Ideal ^ i.63 8 
Organizational Outcomes .862 

Let us examine the scale variancTes Goldharber and Rogers 
report for, the ICA procedures an-d compare them , with *the 6btafined 
variances from the pew instrument. At» the same time# l^t's multiply 
the variances by tire reliabilities to determine the amoun^', of 
reliable variance/ in these twc different procedures. They are 
presented below. ' 
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i882 


|13 


12 ^ ' 


.852 




15 


.6«>9 


12 








17 


.756 


12 


11 . 


.876< 


11 



fract Var X alpha ICA Var X a*lpha 



Info. Received Actual \ 45, 326.^74 39^6V((^.24 . \18.94 16.71 

Info. Receive ^>^aeal 75,078.55 69#922.11 11.74 10.00 ^ 

A ^ . . .. • y ■ , - , : # ^ 

Info. Sources ActualX ^5, 514*10 36^320.25 12.93 9.04 

Info. Sources ideal 57,289\^3 48^008.62 , ;10.08 7.62' 

Organizational Outcome's 57,773.66 49,800.^0 ' 16.86 ^^ ^4.77 

Clearly/ the procedures presented in this paper are capable ^ or 
obtaining more reliah(^le variance than the traditional procedures 
which the ici^ employs- * *. ^ ^ , 
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V, ^pi%sc|^assion and Conclusr9ns 



. Th« results reported here suqqest- tha*t the ICA procedures 

shcyildybe clianqed to use fractionation scales. They provide more 
precis^ measures of organizaticq^ 1 coamunication, they more closely 
•'cprrjesppnd to the real number system and they are reliable, 
fur^iiermore# .M:he s^me substantive rel?ationships were found ^with^^f: the 

'^jirecise scales as those reported by Go^ldhaber and Rogers, however, 

' .. . •) ■ . ^ 

these findings ^ are beyond the scope of this pap^r and) the 

■ ^\ ' ' ' «^ ' 

•^'proprietary nature of the research prevents us from reporting;^ them 

h^re. Let it /Suffice to to say that in terms of validity, ^a^^' nlimber 
of significant relationships wer^ found between these^sb^lc^ items 
and organizational performance me^ures that theoretically should be 
related (e.'g.r absented ismifc product ivity* safety* union .'Activity) • 
The qeneralizability ' of . the repotted findings m|;^ be enhanced 
because the data vere gathered over a vide i^nge of organ^ational 

■ ^ ^ ■ T 

settings *^Xnd vortker attributes. Por theses reasons, we have 

■mm- ^ 
^ohfidelre in our recommendation that the ICA Communication Audit 

should be changed to incorporate fractionation scales Bather than 

the^cruSe, five point, fixed-choice items it currently employs. 

VI. Summary , < T 

This pai^r proposed a new. and more precise method of measuring 

^ y - 

\oraanizat ional Communication than the one cun?^n tly 'used in ;the ICA 



lommunication 'Audit and other similar audit systems. An audit was 

performed to test these procedur^ with employees from :^ive 

.different business groups from within a 'large multinational 

* 

corporation. The results showed that 1) workers can use these scales. 



2) they , use them reliably, 3) these methods produce significantly 
more variaiice than traditional procedures, 4) workers discriminate a 
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litionil 



fixed choice 



qreat'er nunfcer pf values than allowed hj^ tWd: 
items, and, 5) theoreticallf valid relationships. iiere'|o^tained. As a 
result of these f indings\^this paper advocates the adoption of 
direct-maqnitude estimate f ractlonAs^ion scales for the measurement 
of orqanizational communication. ■ ■ j 
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IT. The authors would li 



- / 



ke' to ^hahk J^mes ^nKelad^^gr^j^^roy E. 



Huqhes, Williaa Husson, Dan C. fijfabtree and Thomas, C. Lltwilert 
without whom this paper would not been possible. ilsoV the 

author^ would like to thank Gerald Gcfdhaber for his comments on an 
earlier version of fhe flrSnascr 

1 2. A number of responses wh^h may be labelled statistical 
outliers^ those responses significantly discrepant from tTietfest of 
the distribution of responses werer removed for this analysis. The 
criterion chosen to identify ati obtlier was if the talue waS greater 
than]|3 s.d. from the n^t highest value. There were 19 (.3!!5) 'from 
the 4818 responses in the sample. . 

13. The number of possib]^ unique responses increases as a 
function df1|||(bhe number of people responding to an item. -^he mean 
number of different responses for <^^he five sites in the sample 
demonstrates this clearly. * ' " 



5ite 
1 

2 
3 
4 

5 



Mean 
10. 56 

13.23 
13.56 
16.35 
1 8. 92'' 



64 
'86 
'l98 
25U 



Regression analysis 'indicates that fof^eaclh additional subject. 



there is an increase in the number of 
Y (responses) =10.2 «• , 03 X(subiects)- B=-97. 



responses 



of 



.03. 
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COn^MUNICATlbN SURVEY 



The purpose of this survey is to evaluate our communication practices and find 
■ out what specific areas need improvement. 

To do this, we need you to assess these communication practices. Your ideas and 
responses will help^us make ch£thges for the better. 

Please answej- all questions, since each is important. Leave a question blank only 
if it does n ot apply to you. If there are any qi^estions that you do not understand, 
please ask the survey administrator about them. 

Your responses will be held confidential. Doifiot sign your name. 

Thank you for helping us in this important evaluation. 
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DIRECTIONS 



The questions below use the following scele: 



50 

"T" 



100 



ISO 



Average. 



I 

Twice 
Average 



1~ — 

Three Times 

Average.* , 



On this scale, "50" Is always average and 'V In rjfAxe at all. FolUxample, say that "50" represents the average 
amount of information an employee gets abQiit safety practices Jf "50" is the average amount, then you decide 
how much safety information you get. Use any number that Is right for you^ If you think you get less safety in- 
formation than average, write a smaller number than "50". If you tiet more than an average amount of safety in- 
formation, then write a number larger than "SO" that showf how much m^m than average you get. If you feel 
you get about an average amount, then gse "SO". If you feel you get no information, then use "0". Place your 
number on the line'or in the box to the right of each question. / ( / 

EXAMPLELif "50" is average accuracy, how accurate is your local T.V. news about .7 
If your T.V. news about is above average in accuracy, then use a number above "SO" to show how much. 
You might use '75", "90" or "140", depending on how ebove average the accuracy is. If you feel the reporting 
is less than average i^ccuracy, pick a number sfnaller than "50". If the reporting accuracy is average, use 
"^'50". If it is not accurate at all, then use "0". 



RECEIVING TYPES OF INFORMATION 



Below are typescpf information you may receive from various sources within your organization. Give each 
topic two scores. Rrst, score each for how much of that Information you get, if "50" is the average amount an 
employee ge^. Then score each for how much you would lilce to receive, or how much you need to carry^out 

How Much I 



your work activities in the best way you can 



TOPIC 



Receive 



IHow*Miazfil 
Want/fieed 



Feed^ck on how well 1 do my job 






Day-to-day woric instructions V 






Goals and objectives of my work unit 






Feedback on my work units performance 






benefit plans and how they affect me ^ 






Organizational policies 






Promotion and advancement opportunities 






pay plan and how ft affects me 


* 




Important new products, services or 

proigrams in my organization 

"•^^ , 






Changes in plans or schedul^irom my depart- 
menf s other hinctions which wect<ne 






How my job relates to the total cjiMration 
of my organization ^ 






Fdh)WHjp bnlquesitions, ir^ 
suggestions and coniplaints 1 voice 






Other (Specify) 







m 



' ^URCBSOFINFORMATldN/ 



You may receive Information about and your job from various sources. We .use sources Vor several 
reasons. Some sources are easier to get to, some give better quality information. Some sources are more*ac- 
curate; others are more useful q| timely. On the table below, score each of the sources you use for: (1) how 
much you use them,(2) how much you would like to use them, (3) ease of access, (4) how useful each is to you, 
(5) how accurate each is, and (6) how timely each is for getting you Information. Remember: "SO", is average. It 
will save you time If you do h\lof Column 1 flrst;)then all of Column 2, etc. * ^ 





; HI (2) (31 (4) (51 (6) 


PEOPLE 


You Use 


Hnww Much Vmi'rf 

Like to Use 


Ease of 
Access 


now useTUi 
ForYou 


now 
Accurate 


How 
Timely 


• 

Co*worfcert In my unit 














Worfcor* ih other units 

— -A 


























> 


Middw nrianagars 














Top managm 














Thtgrapavina 








• < 






1 Group nr)a«tihgt» 
roundtabtet, 
P* infomnative mtga. ' 






1 








People who work for m« 














Union representatives 
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<1» 121 (3) (41 


(5) 


(6) 


PUBLICATIONS 


How Much 
You Use 


How Much You'd 
Like to Use 


Ease of 
Access 


How Useful 
ForYou 


How 


How 
1 imeiy 


Local newspaper 














Local publications^ 
newslettefi 














Written letters, 
reports/memos 














Bulletin boards 














Company*wide 
Ahnual Report 














Union puUicatiprw 














Monogram magazine 
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(4) 


(5) (S) 


OTHER SOURCE^ 


How Much 
You Use 


How Much You'd 
Like to Use 


Easeof 
Access 


How Useful 
ForYou 


How 
Accurate 


How 
Timely 


. Localpublie 
newspaper # 














Local radio news 














Local T.V. news 














Other 
CSpedM 















W0ftKEN\^R6NMEI^T 

. -:■/•'.'■ ' ' 

An Important jp^n of v^rking within an organization ia the satisfaction one receives frbm working there. If 
''50'' is the avera^ satis^ctton, how satisfied are you with: # ' 

*Myplant'i,ove^j^ll efficiency of operation J ' ^ , 

the ovei^ii quajity of riiy 

My organization's ac^ievenrient of ib goals and Qbjecti^ ' 

My organizfiwn'ii^yerall iconrirnunicati effort :_ ' 

My nblatiobship with co-workers \, ' . * ' 

l^^e)(tenttoVhichmysupervi80 * 

How free I feel to SMfk my opinion to nriysj^^ ' 

The contribution 1 itiake \f\ accomplisl:ifn£j nif organization's goals 

• • ■■ ' ; . ■ ^ •'^■■^ ■ 

The cooperation of co-workers to accomplish organizational goals ^ ' > 

How proud I am to tell others I work for . \ 

How proud I feel to work in my plant, compared to any other - T." 

BUSINESS RELATED INFORfMATION ^ 

PeriodiSiUy, our communicators igenerate information about the Company and^^jr local plant to try and 
keep yoHjjB^o date. To see how effectively we have managed to get this inforrrlation to you, could you tell 
us.... 

Compared to a year ago, how would you describe the employment level of your location? 

1. ina downturn ' ^ 

2. stable 

3. increasing ' ' ^' • 

Compared to a year ago, is the market for your tocatlon's products or services; 

1. shrinking • ^ 

2. stable 

3. growing ' . 



In coming years, do you feel your business will: 

1. grow 

2. stabilize ' 

3. iBJwink ■ 

What would you My are your location's three most important business objectives for this year? 

1. ' • 

2« » 

3. ■ 

What are your business' end products? (locomotives, electric motors, etc.) 

1. ^ ' - 
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fcist thres customers who purchase these products: 

2. '. . 

3 ' 




List three firms that compete with your local business: ' 

I- : • . — 



3. 



Lastydar, profits were about: 
1. 20 /per dollar of sales . 

2t 60 /per dollar of sales ^ , " 

3. 15^ per dollar of sales ^> 

4. 270/ per dollar of sales 

5. 480 /i^er dollar of sales 

3* 

BACKGROUND INFORMATION 

Sometimes communication patterns are affected by such things as thar^ength of time that a person has been 
on a job, and the number of different job experiences or types of work that he or she has done. These details will 
help us improve our communication techniques for all types of employee groups. To help us, could you tell us... 

How old are you? • 

>1ow many years have you worked for to the nearest yeaH? ^ ^ • 

Please indicate the last school year you completed: ^^'""^ 

6 7 8 9 ^10 11 12 13 14 15 ^^ nj 18 19 20 ^ _1 

How rhany months have^ou worked in your current position? ^ 

- In which function is your current assignment? 

1. Manufacturing ' 

2. Engineering ' 

3. Marketing or Sales 

4. Rnance ' ' * , 

5. Relations 

6. Legal * ^ ^ 
' 7. Research and Development 

8. ^ategic Planning * : . 

9. Program Management 

10. Other (Specify) 

What is your sex? 

1. Male 

2. Female \ - ' 
How many years have you w^ked in your current plant location? 

PWase identify your work stat 

1. Hourly individual contribtitor 

2. Non-exempt salaried clerk\ secretary or technician 

3. Exerillpt indhMUil contributpr 

4. Supervisor 0rfoieman 

5. Manager 

f 

Durinj tHe past ten years. In how miny ^ organizations have you been employed? 




WE WOULD APPRECIATE ANY IDEAS Vdu CAN OFFER ON IMPROVING OUR COMMUNICATION EFFORT: 



We WOULD APPRECIATE YOUR COMMENTS ON THIS SURVEY: 



THANK YOU VERY MUCH FOR YOUR TIME 
AND COOPERATION 



ERIC 
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